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COLOUR CORRECTION 
This invention relates to colour correction. 

Colour correction is a technique used in the production of image or video material to 
replace occurrences of certain colours in original material with corresponding replacement 
colours. Two examples of when this process might be needed are to match the appearance of 
scenes shot under different lighting conditions, or simply to change the appearance of an 
image for artistic reasons. Particularly in the context of this second example, it will be 
understood that the term "correction" does not imply that there was necessarily anything 
intrinsically wrong with the original colour; the way that the expression "colour correction" 
is used in the art (and in the present application) is in fact with the more generic meaning of 
"colour alteration". 

The colour properties of an image are usually considered in one of the following 
representations, often referred to as "colour spaces": as a set of contributions from primary 
colours (e.g. RGB - red, green and blue), as a luminance value (L) plus two colour 
difference values (e.g. Cb, Cr) or as a luminance value (L), a hue value (H) and a saturation 
value (S). In real images (rather than test patterns) what is perceived as a "colour" does not 
correspond to a single point in colour space and so cannot generally be defined as a precise, 
single, set of such values. Instead, what the viewer may perceive as a single "colour" would 
typically occupy a range of values in colour space. For example, an image of, say, a red car 
would have a range of "red" values depending on the local lighting, angle and even 
cleanliness of each area of the car. So, in order to apply colour correction to the "red" of the 
car, in fact a region in colour space is defined to encompass all of the "red" colour exhibited 
by the car. A processing operation is then applied to map that source region to another 
similar (target) region elsewhere in colour space. By mapping the whole region in this way, 
variations in shade are mapped to corresponding variations in shade at the target region. 

The colour correction may thus alter one or more of the colour properties of the 
image. For example, hue could be altered \\'ithout changing the saturation and intensity 
values. 

Colour correction is usually carried out in the digital domain. US-A-6 434 266 
discloses a digital colour correction system in which each pixel value of a source image is 
converted from an RGB representation into an HSL representation. The HSL values are 
compared - pixel by pixel - with a range of HSL values defined as a source range of "colours 
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to be corrected". If a pixel is found to lie within the source range, that pixel is replaced by a 
pixel value in a "target" colour range. 

The source range or locus in colour space may be associated with a "key". Where the 
key is full on (e.g. a value of one) the complete colour correction is applied. Where it is off 
5 (e.g. a value of zero), no correction is applied. In between these two extremes, the key can 
describe the amount of change to be applied. In this way, so-called soft edges may be 
produced at. the periphery of the colour corrected regions of colour space. 

In order to use the key value, the following example logic may be used. First, for the 
HSL position in colour space of a current pixel, the key value k is. established. Then, for an 
10 additive change to luminance or saturation, the change is implemented as: -v.- 

new value = old value + k , delta 
where delta is equal to the full amount of a desired change (i.e. the change which would 
occur where k = 1). 

The simple logic above works well to create additive delta changes in Luminance and 
15 Saturation. However, hue changes are more difficult. It is not possible to simply apply a hue 
change in the rectangular CbCr domain using a CbCr additive vector translation. Though 
this works for spot colour correction, it results in the wrong output value of saturation when 
larger regions of colour space are corrected. 

Changes in hue are preferably applied using a rotation of the existing hue. When in 
20 the HSL domain this is a simple addition to the existing, input, hue. However, in soft areas 
(parts of colour space for which 0 < k < 1) imdesirable colour "rainbow" effects are 
experienced, in that the hue rotation causes the transition to the new colour to pass through 
many similarly saturated additional colours. In soft areas it is more desirable for the softness 
to describe a straight line on the CbCr plane between the original and corrected colour. That 
25 is to say that in softness areas saturation changes as well as hue, in dependence on the key 
value. 

So, there is a conflict of requirements. Where k = 1 , hue changes are better carried 
out in the HSL domain. However, where 0 < k < 1, i.e. in "soft" areas, hue changes are \ 
better carried out as a straight line translation in the CbCr domain. It is possible to overcome 
30 this conflict by producing the hardware needed to create a hue rotation, but operating in the 
Cb Cr domain, but this approach is very expensive in terms of processing overhead. 

This invention provides digital image processing apparatus for applying pixel-based 
colour correction to a hue-saturation-based polar representation of pixels of an input image 
to generate an output image, the apparatus comprising: 
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colour correction logic arranged to provide a colour mapping operation defined by a 
hue alteration amount and a key value associated with each pixel; 
the colour correction logic comprising: 

hue modifying logic for adding a proportion of the hue alteration amount to the hue 
5 of each pixel of the input image, the proportion depending on the key value associated with 
that pixel; and 

saturation modifying logic for modifying the saturation of each pixel in dependence 
on the hue alteration amount and the key value for that pixel, such that for a key value . 
indicating that only a firactipn of the hue alteration amount should be applied to a current 
10 pixel, the saturation of that pixel is also modified so that, when expressed with respect to a 
rectangular chrominance-based colour space, the pixel is moved to a position in that colour 
space substantially lying on a straight line between the original pixel position and the 
position that the pixel would occupy if the full hue alteration amount were applied. 

The invention provides a much more efficient smaller implementation by operating in 
15 the HSL domain, and changing saturation as well as hue, in softness areas, when a change to 
hue is being applied. This is conveniently realised using look-up-tables, because the 
equations that describe the hue and saturation deltas in soft areas are complex. 

Various other respective aspects and features of the invention are defined in the 
appended claims, 

20 Embodiments of the invention will now be described, by way of example only, with 
reference to the accompanying drawings in which: 

Figure 1 is a schematic diagram of a colour correclion system according to an 
embodiment of the present invention; 

Figure 2 schematically illustrates the use of soft regions in colour space; 
25 Figure 3 schematically illustrates a mixing arrangement; 

Figure 4 schematically illustrates a key generator arrangement; 

Figure 5 is a schematic flow chart showing a key priority process; 

Figure 6 schematically illustrates a first em.bbdiment of a key modifier; 

Figure 7 schematically illustrates a second embodiment of a key modifier; 
30 Figure 8 schematically illustrates a bypass controller; 

Figure 9 is a schematic diagram of a mixing arrangement; 

Figures 10a and 10b are schematic diagrams illustrating problems with hue rotation'' 
in a rectangular domain; 
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Figures 11a and lib are schematic diagrams illustrating hue rotation in a polar 
domain; 

Figure 12 is a schematic diagram illustrating hue rotation in a soft region; 

Figure 13 is a schematic diagram illustrating a possible implementation of hue 
rotation in the rectangular domain; 

Figure 14 schematically illustrates hue rotation in the polar domain; 

Figure 1 5 schematically illustrates the derivation of look-up table values; and 

Figure 16 schematically illustrates the use of a look-up table for luminance 
modification. 

The embodiments to be described below may be implemented in hardware, in semi- 
programmable hardware (e.g. application specific integrated circuits or field programmable 
gate arrays), in software running on a general purpose data processing apparatus, or as any 
combination of the above. In the case of software-implemented features, the software may 
be stored in a storage medium (not shown) such as a disk storage medium, a read only 
memory or the like, and/or via a transmission medium such as an internet connection (not 
shown). 

Figure 1 is a -schematic diagram of a colour correction system according to an 
embodiment of the present invention. 

The colour correction system comprises an input processor 1 0, a pre-processor 20, a 
mixer arrangement 30, a post-processor .40, an output processor 50, a bypass buffer 60, a 
mixing controller 70 and a bypass controller 80. 

Input video data is received by the input processor in a 4:2:2 Y,C (luminance, 
chrominance) format. The input processor routes the video data to the pre-processor 20 and 
also to the bypass buffer 60. The input processor also encompasses a stage of up-sampling 
of the chrominance components of the input video signal to a 4:4:4 Y,C format. 

The pre-processor 20 carries out a rectangular to polar conversion of the chrominance 
components to give a (luminance, saturation, hue) (LSH) representation of the video. (Of 
course, tlie rectangular to polar conversion does not change the luminance, only the 
representation of the colour information). This is passed to the mixer arrangement 30 and to 
the mixing controller 70. 

The mixing controller 70 is responsive to key parameters defining regions in colour 
space which are to be altered by the colour correction system. The mixing controller 70 
detects whether the L,S,H values in respect of a current pixel lie within a region of colour 
space defined to be altered. The mixing controller generates a key value k defining whether 
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the current pixel is to be altered and, in at least some embodiments, a degree to which 
alteration is to take place. The key value k is passed to the mixer arrangement 30. 

The mixing controller 70 also passes information to the bypass controller 80 which, 
in effect, defines any pixels which have not been altered by the colour correction system, 
5 The bypass controller 80 generates a bypass control signal which is used by the output 
processor 50 to route the input (unaltered) data buffered in the bypass buffer 60 as output 
data in respect of those pixels where no alteration has been made. This means that the effect 
of filtering and other processors taking place at the input processor 10, the pre-processor 20, 
the mixer 30 and the post-processor 40 are not applied to any pixels where no alteration is in 
10 fact required. 

Retuming to the mixer arrangement 30, this receives the L,S,H values of a current 
pixel and a key value k in respect of that pixel. The key value controls the degree of 
alteration or colour correction processing applied to that pixel. An alteration is carried out in 
proportion to the key value. If k = 0, then no alteration is made to that pixel. If k = 1 then 
15 the full amount of a predetermined alteration is made. If 0 < k < 1 then a proportion of the 
predetermined alteration is made. 

In Figure 1, only a single stage of mixing controller 70 and mixer arrangement 30 is 
illustrated, but in a preferred embodiment six consecutive such stages are provided. 

The post-processor 40 carries out a polar to rectangular conversion back to a 4:4:4 
20 Y,C format along with a limiting function to remove any so-called "illegal" colours 
generated by the mixer arrangement 30. Illegal colours lie outside a range of colours deemed 
to be legal, which is generally is taken to be a range outside a so-called "colour cube". 

Finally, the output processor 50 provides the bypass mixing function described above 
and also provides a down sampling function back to 4:2:2 Y,C format. 
25 It will be seen from Figure 1 that relative delays are applied to compensate for the 

processing delay of the up sampling, rectangular to polar conversion, polar to rectangular 
conversion and down sampling processors. 

Figure 2 schematically illustrates the use of a key value k and so-talled "soft" key 
values, to define a colour correction. 
30 A region or locus 92 in colour space (e.g. a rectangular CrCb space) is defined so as 

to have a key value equal to a certain amount (e.g. a maximum key value, which in the 
present embodiment will be taken as being equal to 1). Well away form that region, for 
example at a position 96, the key value is set to another predetermined amount, such as zero. 
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A colour alteration 94 is defined in respect of that keyed region. This maps the region 92 
onto a corresponding region 92'. 

Now, for a current pixel, the colour attributes (Cb, Cr in this case) of that pixel are 
compared with the keyed region. If the attributes of the current pixel are found to lie within 
5 the keyed region, then the alteration 94 is applied to that pixel. If the key value is zero for 
that current pixel, then no colour correction change* is applied. 

However, it is possible to set a key value which represents neither "a full change" nor 
"no change at all". In the present embodiment this is achieved by using a key value of 
greater than zero but less than one. Regions 98 having a key value k where 0 < k < 1 are 
10 referred to as "soft" regions and are shown schematically as shaded regions in Figure 2. 

In a soft region, a partial colour correction operation is carried out. That is to say, a 
part of the alteration 94 is applied to a pixel having colour attributes corresponding to a soft 
region. The amount or proportion of the transition may conveniently be set so as to be 
proportional to the key value. 
15 The problem of how to handle a partial colour transition is discussed extensively in 

the following description. 

Figure 3 schematically illustrates a mixing and mixing control arrangement. 
A succession of mixers 31, 32, 33.... are used. In actual fact, six such mixers are 
used, with the output of a mixer forming the input to a next mixer in the sequence: Each 
20 mixer uses a respective key signal ki, k2, ks. . . 

The key signal ki for the first mixer 31 is generated by a first key generator 71. 
Similarly, a key signal ky for the second mixer is generated by a second key generator 72. 
The key signal from the first key generator and the key signal fi-om the second key generator 
are supplied to key modifying logic 73. This generates two outputs: one is the key which 
25 is actually used to control the second mixer, and another is kf - effectively a "running total" 
key amount - which is passed to a next stage of key modifying logic in the sequence. The 
key k2 is delayed by a delay 74 so as to arrive at the second mixer 32 at the same time as the 
(potentially modified) pixel datk to v/hich it refers. 

Continuing down the chain, a third key generator 75 supplies a key ky via a 
30 compensation delay 76, to a second key modifying logic 77, which also receives a running 
- total key value kf from the key modifying logic of the preceding stage. This outputs a key ks 
which, via delays 78, is supplied to the third mixer 33. 

The basic principle underlying the key generation and key modifying logic is that a 
position in colour space which has been modified by an earUer mixing operation in the 
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sequence of mixing operations should not be modified again. So, if a key value of 1 
(complete alteration) has been generated by an earlier key generator in respect of that 
position in colour space, later key generators are inhibited from generating a non-zero key 
value in respect of the same colour space position. If a key value representing a partial 
5 modification has been generated in respect of a particular position in colour space, then a 
further jpartial modification is allowed to be passed to the key modifying logic. The "running 
total" key, kf, represents the total amount of modification applied to that pixel by preceding 
key generators in the sequence. So, if the first key generator had generated a key value of, 
say, 0.2 in respect of a current pixel, and the second key generator had generated a key value 
10 of, say, 0.1 in respect of that pixel, then the running total key value kf passed to the third key 
generation stage would be 0.3. The maxirnum key value ks which could be passed by the 
key modifying logic of the third stage would then be (1-0.3) = 0.7. 

As mentioned above, it is preferred that a succession of six mixers with 
. corresponding key generation is provided, but for clarity of the diagram, Figure 3 shows only 
15 three stages of the mixing process. Accordingly, in a final stage, the key modifying logic 77 
outputs a key kf which provides an input (via a delay 79) to the bypass controller 80. 

Figure 4 schematically illustrates a key generator such as the key generator 71, 72 or 

75. 

The key generator receives luminance (Y) chrominance (Cb, Cr) and saturation (S) 
20 data in respect of a current pixel. A key value ky is generated in dependence on these 
attributes of the current pixel and on 13 constants Ci ... C13. Considering the operation of 
Figure 4 in terms of some intermediate values Ii . . . Ig, it can be seen that: 

Ii=Ci2+(Ci * Cb) + (C2*Cr) 

12 = Ci3 + (C3*Cb) + (C4*Cr) 

25 The outputs Ii and I2 represent a rotation of the hue of the pixel. 

An operation referred to as "NEGNAM" (negative non additive multiplexing) 
signifies that the numerically lower of the inputs to the NEGNAM is passed as its output. 
So: 

13 = the lower of Ii and I2, subject to a limiting operation to prevent overflow. 

30 

14 == 1 - (C5 + V(Ii^ + l2^)), subject to a shift operation and a limiting operation. The 
reason for the shift operation is as follows. To avoid imnecessary processing overheads, the 
gain that needs to be applied using Ci to C4 is split into two parts, a fractional component 
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and a power-of-two component. The fractional component is applied by the multiplication 
by C1..C4. and the pov/er-of-two component is applied as a bit shift. 

I5 = Cg * (ABS (Y + Ce) + C7) subject to a limiting operation to prevent overflow 
5 l6 = Cii * (ABS (S -f- C9) + Cio) again subject to a limiting operation to prevent 

overflow 

Here, I5 may be considered as a luminance key and Is as a saturation key. 

I7 = either I3 or I4, depending on whether operation is in a "sector mode", so that the 
10 keyed region represents a sector in colour space, or "ellipse mode" in which the keyed region 
represents an elliptical region in colour space. I3 is selected in sector mode and I4 is selected 
in ellipse mode. 

Ig = the lower of (I7 and the lower of (I5 and le)) 

15 

The value Ig is then ''shifted and softened" to form the key value ky. The shifting and 
softening operation allows modification of the key edges to better align them to the boundary 
of the region being corrected. 

Figure 5 schematically illustrates the process used to handle the running total key 

20 values kf and the newly generated key values kv. In the present embodiment the process is 
carried out in hardware, but the flowchart of Figure 5 schematically illustrates how the 
process may be carried out if the key modifying logic referred to above is implemented as 
programmable data processing apparatus, running a program stored on a storage medium 
such as a read only memory or a disk storage medium, or received via a network cormection 

25 such as an internet connection. 

At a start 100, the running total key value, kf, for a current pixel is set to zero. At a 
step 110, the first key generator 71 generates the first key value kv. At a step 120, a 
comparison is made between kv and (1-kf). If kv > (1-kf) then (1-kf) - the remaining amount 
of key available at that pixel - is passed 140 to the mixer 31. Otherwise (as would be the 

30 case for tlie first key generation stage) if (1-kf) >= ky, then kv is peissed 130 in fall to the 
mixer 3 1 . 

At a step 1 50 the running total key kf is increased by the amount of ky, subject to a 

maximum value for kf of 1 . 



P/16106.GB 



If at a step 160, it is found that the sequence of mixing operations is complete, the 
process ends. Otherwise, at a step 170, the process returns to operate in respect of the next 
key generation step. 

The following table illustrates the operation in respect of the running total key kf and 
a newly generated key value ky. 



Input 


Output 


to key modifying logic 


from key modifying logic 


Kf 


Kv 


Kf 


Kv 


1 


1 


1 


0 


0 


1 


1 


1 


1 
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1 


0 


0 


0 


0 


0 


0.5 


1 


1 


0.5 


0.2 


0.3 


0.5 


0.3 


0.7 


0.9 


1 


0.3 



Figure 6 schematically illustrates a hardware implementation of the key modifying 
logic 73,77... 

10 The value kf is supplied in parallel to a subtracter 200, which generates a value (1-kf), 

and an adder 220. 

The value (1-kf) is passed from the subtracter 200 to a NEGNAM 210, which 
receives as a second input the newly generated key value kv. The NEGNAM 210 outputs 
the lower of ky and (1-kf) as the current key to be used by the current mixing arrangement. 
15 The output of the NEGNAM 210 is also passed to the adder 220, where it is added to the 
existing kf to form the new running total key value kf. 

Figure 7 schematically illustrates a second embodiment of the key modifying logic 

i 

which also handles a "running total" bypass value Exf. 

As mentioned above, to ensure that the colour corrector is transparent to pixels for 
20 which no change is made, the final running total key value, kf, may be used to derive a 
control signal for the bypass function. So, if a pixel has been modified to any extent by any 
of the mixing stages (i.e. if kf > 0 for that pixel) then the output of the sequence of mixing 
arrangements is used as the output pixel. If, however, kf = 0 for that pixel, this shows that 
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the pixel has not been modified by the colour correction process, and so the bypass 
(buffered) value of the original pixel is used as the output pixel. 

An exception can occur in the following circumstances. It is possible to use one of 
the earlier stages in the sequence of mixing arrangements to exclude certain regions of colour 
space from any modification at all. This is done by deriving a key in respect of that region 
but setting the parameters controlling the corresponding mixing arrangement to provide a 
zero change. Because of the use of key modifying logic and the rurming total key, kf, as 
described above, this will have the effect of inhibiting any subsequent change at that region 
of colour space by following mixing arrangements in the sequence. 

Using the basic "bypass" method based on kf alone, such "excluded" pixels 
corresponding to the excluded region of colour space will be output from the chain of mixing 
arrangements rather than from the bypass buffer. But as the pixels corresponding to that 
region of colour space will not have been modified, it would be more appropriate to use the 
buffered pixels as output. 

Referring to Figure 7, a running total exclude flag Exf is derived, at each stage, by an 
OR operation between the previous value of Exf and an AND combination of ky (the key 
value output by the current key modifying logic and used to control the current mixing 
arrangement) and a flag Exv (a flag set high when the current key generator is in an "exclude" 
mode of operation). 

Using this arrangement, a key generator set to exclude mode will set Exf high if the 
current pixel has its key value's MSB set to 1 by that key generator. The logic implies that 
Exf, once set high, cannot be set low by a subsequent key modifying logic stage. 

Figure 8 schematically illustrates a bypass controller. The bypass controller receives 
as inputs the running total key value kf and the mrming total exclude flag Exf. A bypass 
control output is generated as: 

nbypass = (kf doesn't equal zero) AND (NOT Exf) 
If the key. is non-zero and the exclude flag has not been set, then the bypass (buffered) pixel 
is not to be selected, ^ 

Figure 9 is a detailed schematic diagram of part of the mixing arrangement 30 shown 
in Figure 1. The mixing arrangement 30 comprises coloui* correction logic operable to effect 
desired additive changes to hue, saturation and luminance and multiplicative changes to 
saturation and luminance. The mixing arrangement logic operates in the polar domain. 

The mixing arrangement has as its inputs initial values for hue, saturation and 
luminance from the pre-processor 20, as well as a key value k from the mixing controller 70 
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(which defines whether the current pixel is colour corrected, and if so, by how much) and 
also desired modifiers including additive deltas for hue, saturation and luminance, and gain 
for saturation and luminance. 

Hue modification is carried out by logic 502. The logic 502 relates, only to additive 
5 changes (shifts) in hue. The logic 502 comprises a look-up table (LUT) 520 which tabulates 
the equations required in providing a smooth colour transition in soft regions of colour space 
(regions for vvhich 0 < k < 1). It is noted that a smooth colour transition between initial and 
desired hue through soft areas of colour space requires a change in saturation as well as hue 
in the polar domain. This is discussed later vsdth reference to Figures 10a, 10b, 11a, lib and 
10 12. The contents of the look-up table 520 are described later with reference to Figures 14 
and 15. The look-up table 520 takes the key value k as an input and produces an output to be 
summed with the input hue by an associated adder 522. This generates an output hue. 

Saturation modification is carried out by logic 504. The saturation logic relates to 
both additive (shift) changes and multiplicative (gain) changes. As noted above, smooth 
15 transitions between input and desired hues also require modification to saturation in soft 
regions, and so these changes are implemented also within the saturation logic 504. 

The logic 504 comprises a look-up table 540 which provides multiplicative changes 
to saturation, to operate with the hue changes described above to provide a smooth alteration 
in soft regions. The look-up table 540 takes the key value k as an input and produces an 
20 output to be passed to a multiplier 542 to.be multiplied by the input saturation. The result of 
the multiplicative operation is then passed to an adder 546 to be summed with the result of 
any desired additive modifications. The desired additive saturation change 5Sat is taken as 
an input to multiplier 544. The second input to the multiplier 544 is key value k. 5Sat and k 
are multiplied together by multiplier 544 and the result is passed as an input to the adder 546 
25 to be summed with the output of the multiplier 542. The sum of the additive and 
multiplicative modifications to saturation results in an output saturation. 

Luminance modification is carried out by logic 506, The luminance logic relates to 
both additive (shift) changes and multiplicative (gain) changes. The logic 506 operates in a 
similar way to the saturation logic 504, apart from different look-up table data. 
30 The logic 506 comprises a look-up table 560, which provides muitipiicative changes 

to luminance, to operate with the hue changes described above to provide a smooth alteration 
in soft regions. The content of the table is considered later with reference to Figure 16. The 
look-up table 560 takes the key value k as an input and produces an output to be passed to a 
multiplier 562 to be multiplied with the input luminance. The result of the multiplicative 
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operation is then passed to an adder 566 to be summed with the result of any desired additive 
modifications. The desired additive luminance change 5Y is taken as an input to multiplier 
564, The second input to multiplier 564 is key value k. 6Y and k are multiplied together by 
the multiplier 564 and the product is passed as an input to an adder 566 to be summed with 
the result of the above described multiplicative modifications. The summation of the 
additive and multiplicative modifiers results in an output luminance. 

The output hue, saturation and luminance are then passed on to the next mixing 
arrangement in the sequence or, in the case of the last mixing arrangement, to the post 
processor 40. 

The look-up tables may be supplied with data once per field, once per frairie etc. The 
data may be supplied by data generating means (not shown) within the mixing arrangement 
or by an extemal data processing apparatus (not shown) 

Part of the reason for using the look-up tables for hue modification will now be 
described. In basic terms, it has been recognised that it is not possible to simply apply a hue 
change in the Cb,Cr domain using a deltaCb and deltaCr additive vector translation. The 
reasons behind this will now be explained. 

> Simple additive logic works well to create additive delta changes in Luminance and 
Saturation, but hue is more complicated. Hue can be considered in either the polar or the 
rectangular (Cb,Cr) domains. 

Figure 10a schematically shows a simple additive logic applied to try to create a hue 
shift in the rectangular domain. Though this works for spot colour correction, that is, 
correction or alteration of colours represented by single points in colour space, it can result in 
the wrong output value of saturation when larger regions of colour space are corrected. 
(Here, it is noted that what a viewer may perceive as a single "colour" would normally 
occupy a region in colour space). Referring to Figure 10b, it can be seen that if an additive 
correction amount is set up in the rectangular domain which is correct for, say, a spot colour 
620 (mapping it to a corresponding colour 620'), such a correction will normally be quite 
inappropriate for other spot colours in the same colour region, such as a colour 610 (mapped 
to a corrected colour 610') and a colour 630 (mapped to a corrected colour 630'). The 
saturation of the colours 610' and 630' will be very different to the saturation of the input 
colours 610 and 630. 

This problem can be alleviated by operating in the hue (polar) domain. Figure 1 1 a 
schematically shows a simple additive logic applied to hue shift in the polar domain. Here, a 
change in hue represents a rotation in the rectangular domain. This maintains the correct 
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saturation for different positions within a region of colour space - for example, the: colour 
610 is correctly mapped to the colour 610", and the colour 630 is now correctly mapped to 
the colour 630". 

However, operating in the polar domain can introduce other problems. In particular, 
in "soft" regions (where 0 < k < 1) of colour correction, which typically are set up so as to 
occur around the edges of regions to be corrected, undesirable colour "rainbow" effects may 
be experienced. The reason for this will now be explained with reference to Figure 12. 

Figure 12 schematically shows a hue shift represented in the polar domain. The hue 
shift can be most easily described as a hue rotation by an angle 720, so that (for example) an 
input colour 7 1 0 is altered to a corrected colour 710'. 

In a basic arrangement using a hue rotation implemented in the polar domain, a 
correction in a "soft" region (where 0 < k < 1) would result in a partial rotation by an angle 
given by: 

hue rotation = k . (angle 720) 

So, for a key value k of, say, 0.3, a rotation of the colour 710 to a corrected colour 
710" would occur. This represents a rotation by an angle equal to 30% of the angle 720. 

However, in soft areas it is more subjectively desirable for the partial correction to 
describe a straight line 740 on the Cb,Cr plane between the original and corrected colour. 
So, for a key value k of 0,3, it is more subjectively desirable for the colour 710 to be altered 
to give a corrected colour 710"'. 

This means however, that in softness areas saturation will change as well as hue 
(saturation being represented by the distance from the origin to the line 740). 

It is possible to implement this by producing the hardware needed to create a rotation, 
but operating in the rectangular (Cb,Cr) domain, but this is undesirable because a lot of 
hardware is required. A possible logic arrangement suitable for carrying out this rotation in 
the rectangular domain is shown schematically in Figure 13. This involves the calculation of 
sines and cosines of the desired hue change, and generally is very expensive in terms of 
hardware or processing operations. In contrast, the! present embodim.ent provides an 
elegantly simpler technique which is much less expensive of hardware or processing 
operations. 

As described above, when hue alterations are implemented in the polar domain, it is 
subjectively desirable to change saturation as well as hue, when a hue change is being 
applied and 0 < k < 1 . This can conveniently be realised using look-up tables, because the 
equations that describe the hue and saturation deltas in soft areas are complex. 
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Figure 14 schematically illustrates those parts of the arrangement of Figure 9 which 
are relevant to hue modification in soft regions. The look-up tables 520 provides alteration 
values required for a shift in hue, and the look-up table 540 provides alteration values 
required for a change in saturation. Both look-up tables take the key value key as an input. 
The equations from which the look-up table values (for both saturation and hue) axe 
generated are considered below with reference to Figure 15. Note that the modified 
saturation shown in Figure 14 is not necessarily the final output saturation, as it may still be 
modified by any desired direct changes to the gain or delta of the original saturation. 

The hue look-up table is used to alter the hue in a fashion to ensure that there is a 
linear transition along the line 740 with respect to the changing key value. 

The contents of the two look-up tables of Figure 14 can be generated using the 
geometry shown in Figure 1 5 and known trigonometrical identities. Figure 1 5 schematically 
illustrates a colour correction operation in the rectangular (Cb,Cr) domain. In Figure 15: 

The variable "I" represents the total change that is caused by the colour correction 
operation, i.e. when k = 1 . 

The variable "Ahue" represents the total hue rotation that is caused by the colour 
correction operation, i.e. when.k = 1 . 

The variable "i" represents an incremental (vector) change caused by a partial value 
of k, i.e. a value for which 0 < k < 1 . 

The variable "s" represents the desired saturation in the situation that 0 < k < 1 . 

The variable "9" represents the hue change (rotation) which is required when 
0<k<l. 

The variable "Sat" represents the saturation of a current pixel. 

To ensure that as the key value increases a straight-line transition will be made from 
the initial colour to the corrected colour in the rectangular domain, it is necessary to use: 
i = I.k 
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To obtain the saturation look-up table 840, the following equations are required: 

s = Sat . 

Sin(90 - Ahue/2) Sin(l 80 - 0 - (90 - Ahue/2)) 

s = Sat * Cosf Ahue/2) . 

Cos(Ahue/2 - 9) 

So, the contents of the satxiration look-up table are defined by: 

CosfAhue/2) . 
Cos(Ahue/2 - 0) 

and this value is multiplied by the current pixel's saturation. Sat. The input to the 
look-up table appears to be the angle 0, but this is in fact a function of the incoming key 
value k, which will now be shovm in relation to the generation of the hue look-up table 820. 

For the hue look-up table 820, the following equations are required: 

I Sat . 

Sin(Ahue) Sin(90 - Ahue/2) _( 1 ) 

i = Sat . 

Sin(0) Sin(l 80 - 0 - 90 + Ahue/2) _(2) 

Substituting 1 and 2 into the above, and solving for tan(0), gives: 

1 , 

1 -tan(Ahue/2) = tan(0) 

k*Sin(Ahue) 

This means that the angle 0 is the arctangent of the left hand side of the equation 
above. It is this that is used in the hue look-up table 820, with key value k as the input and 

V 

the angle 0 as the output. This output angle 0 is then added into the input hue angle to create 
the modified hue. 

This equation is also used to relate k to the angle 9 for use with the saturation look-up 
table 840. This means that the input for the saturation look-up table can be k. 
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Because tangent is not a continuous function, and because it is important to prevent 
divide-by-zero errors, some exceptions are needed in the firmware that calculates the look-up 
table contents. These exceptions are: 

5 (a) k= 0 

(b)k==l 
(c) 

1 - tan(Ahue/2) = 0 

k*Sin(Ahue) 

(d) Ahue >= 1 80 degrees 
10 These exceptions can be handled using the following procedures: 

(i) if Ahue < -180 degrees, add 360 degrees to Ahue 

(ii) if Ahue > 180 degrees, subtract 360 degrees from Ahue 

(iii) if the absolute value of Ahue > 179.9 degrees (i.e. nearly 180 degrees) then: 

15 if k < 0.5, set the look-up table (LUT) value of hue change to zero and the 

saturation LUT value to ( 1 -2k); 

otherwise (i.e. if k >= 0.5) set the LUT value of hue change to Ahue and the 
saturation LUT value to (2k- 1) 

20 

(iv) if k = 0 then set the LUT value of hue change to 0 and the saturation LUT value to 1 ; 
else if k is exactly equal to 1 , set the LUT value of hue change to Ahue and the saturation 
LUT value to 1, 

tan(Ahue/2) = x = 0 



25 (v) when 



K*Sin(Ahue) 



30 



the hue LUT value should be set to 90*^. However, when x, above, is nearly equal to zero 
(i.e. within a predetermined amount, SMALLNUMBER, of zero), the hue look-up table 
should also be set to 90°. 
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The present embodiment uses a 10-bit hue value. This implies that 360 degrees of 
hue rotation corresponds to a hue change of decimal 1024. So, the smallest number of 
degrees of hue change is represented by 1 / 1024. 

This means that the closest distinction that can be made between 90 degrees and the 
next number of degrees is: 90 (360 / 1024) = 89.6484375. 

The tangent of this is 162.9726164. 

Finally, 1/x is required to give: x = 0.00613600158 = SMALLNUMBER. 

Using the above criteria and exceptions, it is possible to construct look-up tables for 
hue £Lnd saturation which provide accurate values for a linear transition across the rectangular 
domain, allowing the operation of the logic itself to take place in the polar domain. 

The previous logic works to provide an additive change. However, it is also 
advantageous to create a multiplicative delta, as implemented in the logic of Figure 9. 

Figure 16 illustrates the logic required to provide a multiplicative change to 
saturation and luminance. This is only applicable to saturation and luminance - as discussed 
above multiplicative changes are not relevant to hue. To save on multipliers these changes 
are implemented using a look-up table 920 and a multiplier 940. From Figure 16 it can be 
seen that the appropriate value of the look-up table 920 is applied to the multiplier 940 to be 
multiplied together with the input to provide the appropriate output. The gain in both cases 
is embodied in the values of the look-up table. In the case of saturation, the gain is applied 
by multiplying the contents of the look-up table 920 with the desired gain (except for K=0 
which is left with unity gain for when the key is off ) and applying the appropriate look-up 
table value to multiplier 940 to be multiplied together with the input saturation. The output 
of the multiplier 940 being the modified saturation. Note that in this case of saturation, the 
look-up table 920 and the multiplier 940 are embodied in Figure 9 as look-up table 540 and 
multiplier 542. The look-up table for saturation has the dual purpose of providing for desired 
saturation gain and hue-related saturation modification. 

In the case of luminance, the content of the look-up table 920 is described by the 
equation: 

1 + k * (Desired luminance gain - 1) 
Tlie look-up table 920 then takes key value k as an input and produces an output to be 
applied to the multiplier 940 and thus multiplied together with the input luminance to 
provide the modified luminance. For luminance, the look-up table 920 and the multiplier 
940 are embodied in Figure 9 as look-up table 560 and multiplier 562, 
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In so far as the embodiments of the invention described above are implemented, at 
least in part, using software-controlled data processing apparatus, it will be appreciated that a 
computer program providing such software control and a storage or transmission medium by 
which such a computer program is provided are envisaged as aspects of the present 
invention. 
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CLAIMS 

1. Digital image processing apparatus for applying pixel-based colour correction to a 
hue-saturation-based polar representation of pixels of an input image to generate an output 
image, the apparatus comprising: 

colour correction logic arranged to provide a colour mapping operation defined by a 
hue alteration amount and a key value associated with each pixel; 
the colour correction logic comprising: 

hue modifying logic for adding a proportion of the hue alteration amount to the hue 
of each pixel of the input image, the proportion depending on the key value associated with 
that pixel; and 

saturation modifying logic for modifying the saturation of each pixel in dependence; 
on the hue alteration amount and the key value for that pixel, such that for a key value 
indicating that only a fraction of the hue alteration amount should be applied to a current 
pixel, the saturation of that pixel is also modified so that, when expressed with respect to a 
rectangular chrominance-based colour space, the pixel is moved to a position in that colour 
space substantially lying on? a straight line between the original pixel position and the 
position that the pixel would occupy if the full hue alteration amount were applied. 

2. Apparatus according to claim 1, in which the colour mapping operation is defined by 
the hue alteration amount and the locus in a colour space of a key value, the colour 
correction logic being operable to detect the key value at that pixel's position in colour space 
and to apply the colour mapping operation to that pixel in dependence on the key value. 

3. Apparatus according to claim 1 or claim 2, in which the hue modifying logic 
comprises a hue data store, addressable by the key value associated with a pixel, the hue data 
store providing a hue amount to be added to the hue of the current pixel. 

4. Apparatus according to claim 3, comprising means for storing hue amount data in the 
hue data store in respect of each image to be processed. 

5. Apparatus according, to any one of claims 1 to 4, in which the saturation modifying 
logic comprises a saturation data store, addressable by the key value associated with a pixel. 
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the saturation data store providing an amount by which the saturation of the current pixel 
should be altered. 

6. Apparatus according to claim 5, comprising means for storing saturation amount data 
5 in the saturation data store in respect of each image to be processed. 

7. Apparatus according to any one of the preceding claims, in which, for a key value 
indicating that the whole of the hue alteration amount should be added to a current pixel, the 
saturation modifying logic is arranged not to alter the saturation of the current pixel. 

10 

8. Apparatus according to any one of the preceding claims, the apparatus being arranged 
to process a video .signal comprising a succession of images. 

9. Digital image processing apparatus substantially as hereinbefore described with 
15 reference to the accompanying drawings. 

10. A method of digital image processing for applying pixel-based colour correction to a 
hue-saturation-based polar representation of pixels of an input image to generate an output 
image, the method comprising the steps of: 

20 defining a colour mapping operation by a hue alteration amovmt and a key value 

associated with each pixel; 

adding a proportion of the hue alteration amount to the hue of each pixel of the input 
image, the proportion depending on the key value associated with that pixel; and 

modifying the saturation of each pixel in dependence on the hue alteration amount 

25 and the key value for that pixel, such that for a key value indicating that only a fraction of the 
hue alteration amount should be applied to a current pixel, the saturation of that pixel is also 
modified so that, when expressed with respect to a rectangular chrominance-based colour 
space, tlie pixel is moved to a position in that colour space substantially lying on a streiight 
line between the original pixel position and the position that the pixel would occupy if the 

30 full hue alteration amount were applied. 

11. A method of digital image processing, the method being substantially as hereinbefore 
described with reference to the accompanying drav/ings. 



) 
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12, Computer software having program code for carrying out a method according to 
claim 10 or claim 11. 



13. A providing medium for providing software according to claim 12. 

5 

14. A medium according to claim 13, the medium being a transmission medium, 

15. A medium according to claim 14, the mediimi being a storage medium. 
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ABSTRACT 

COLOUR CORRECTION 

Digital image processing apparatus for applying pixel-based colour correction to a 
hue-saturation-based polar representation of pixels of an input image to generate an output 
image comprises colour correction logic arranged to provide a colour mapping operation 
defined by a hue alteration amount and a key value associated vsdth each pixel; the colour 
correction logic comprising: hue modifying logic for adding a proportion of the hue 
alteration amount to the hue of each pixel of the input image, the proportion depending on 
the key value associated with that pixel; and saturation modifying logic for modifying the 
saturation of each pixel in dependence on the hue alteration amount and the key value for 
that pixel, such that for a key value indicating that only a fraction of the hue alteration 
amount should be applied to a current pixel, the saturation of that pixel is also modified so 
that, when expressed with respect to a rectangular chrominance-based colour space, the pixel 
is moved to a position in that colour space substantially lying on a straight line between the 
original pixel position and the position that the pixel would occupy if the full hue alteration 
amount were applied. 

Figure 12. 
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